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Scientific  Progress 


This  project  involves  detecting  objects  from  various  video  samples  by  searching  for  local  features  to  describe  each  part  of  the 
image,  and  feeding  these  detections  to  a  grid-based  Bayesian  algorithm.  The  results  obtained  include 


1.  A  constrained  shape  manifold  method  for  shape  based  recognition  and  retrieval  has  been  developed  through  building  a  novel 
quantitative  shape  description  scheme  that  constructs  constrained  shape  spaces  with  the  aid  of  physically  meaningful 
transformations  of  the  underlying  structural  invariant.  A  paper  [1]  reporting  on  this  result  is  currently  under  revision  for  IEEE 
Transactions  on  Image  Processing. 

2.  A  grid-based  algorithm  has  been  developed  for  tracking  that  drastically  outperforms  the  existing  algorithms  in  terms  of 
computational  efficiency,  accuracy  and  robustness.  Furthermore,  by  judiciously  incorporating  feature  representation,  sample 
generation  and  sample  weighting,  the  grid-based  approach  accommodates  contrast  change,  jitter,  target  deformation  and 
occlusion.  Tracking  performance  of  the  proposed  grid-based  algorithm  is  compared  with  two  recent  algorithms,  the  gradient 
vector  flow  snake  tracker  and  the  Monte  Carlo  tracker,  in  the  context  of  leukocyte  tracking  and  UAV-based  tracking.  This 
comparison  indicates  that  the  proposed  tracking  algorithm  is  approximately  100  times  faster,  and  at  the  same  time,  is 
significantly  more  accurate  and  more  robust,  thus  enabling  real-time  robust  tracking.  A  paper  [2]  reporting  on  this  result  has 
been  published  in  Digital  Signal  Processing. 

3.  A  method  was  developed  to  enhance  its  capability  in  accommodating  the  tracking  of  targets  in  video  with  erratic  motion,  by 
introducing  adaptation  in  the  motion  model  and  iterative  position  estimation.  Tracking  performance  of  the  resulting  algorithm  is 
compared  with  the  original  grid-based  Bayesian  tracker  in  the  context  of  leukocyte  tracking  and  UAV  based  vehicle  tracking  to 
demonstrate  its  effectiveness  in  dealing  with  erratic  target  movement.  Relevant  results  have  been  presented  at  the  2013 
IS&T/SPIE  Electronic  Imaging  [3]  and  are  under  review  for  publication  in  the  journal  Pattern  Recognition  [4]. 

4.  Trackability,  defined  as  a  numerical  measure  associated  with  a  video  for  a  given  target  that  increases  with  decreasing 
difficulty  of  tracking  the  target,  is  examined.  The  method  applied  to  quantify  trackability  is  grounded  in  information  theory.  First, 
a  measure  of  similarity  between  the  target  signal  and  the  template  is  established  by  way  of  mutual  information.  This  mutual 
information  becomes  a  three  variable  analysis  as  the  influence  of  clutter  is  considered.  The  effects  of  video  quality  are  included 
in  a  traditional  Shannon-  Hartley  computation  and  the  motion  of  the  target  and  registration  of  the  video  are  used  to  modify  this 
quality  motion  term.  The  sum  of  both  terms,  computed  in  bits  per  second,  yields  trackability.  Fifteen  tracking  experiments  show 
a  promising  Spearman  rank  correlation  between  the  trackability  and  the  actual  tracking  performance.  A  paper  [5]  reporting  on 
this  work  has  been  presented  at  the  2012  19th  IEEE  International  Conference  on  Image  Processing. 

5.  A  trackability  measure  was  developed  in  an  information  theoretic  framework.  The  tools  of  information  theory  allow  a  measure 
of  trackability  that  seamlessly  combines  the  video  dependent  aspects  with  the  target-dependent  aspects  of  tracking  difficulty 
using  measure  of  rate  and  information  content.  Specifically,  video  quality  is  encapsulated  into  a  term  that  measures  spatial 
resolution,  temporal  resolution  and  signal-to-noise  ratio  by  way  of  a  Shannon-Hartley  analysis.  Then,  the  ability  to  correctly 
match  a  template  to  a  target  is  evaluated  through  an  analysis  of  the  mutual  information  between  the  template,  the  detected 
signal  and  the  interfering  clutter.  The  developed  trackability  measure  is  compared  to  the  performance  of  a  recent  tracker  based 
on  scale  space  features  computed  via  connected  filters.  The  results  show  high  Spearman  correlation  magnitude  between  the 
trackability  measure  and  actual  performance.  A  paper  [6]  reporting  on  this  work  has  been  presented  at  the  2012  IS&T/SPIE 
Electronic  Imaging. 

6.  An  adaptive  approach  to  enhancing  images  obtained  from  an  array  of  ultrasonic  transducer  elements  has  been  proposed  and 
evaluated.  The  basic  algorithm  is  driven  by  a  system  of  partial  differential  equations  that  1 )  reduce  speckle  by  way  of  the 
instantaneous  (local)  coefficient  of  variation  and  2)  force  congruence  with  an  anatomical  model  using  a  well-known  perceptual 
quality  metric.  A  differential  form  of  the  quality  metric,  the  structural  similarity  image  measure  (SSIM),  is  derived  and  applied. 
This  update  mechanism  registers  the  image  data  to  the  model,  thus  solving  segmentation  simultaneously  with  enhancement. 
The  algorithm,  called  SSIM  diffusion,  is  tested  on  a  needle  placement  application  in  phlebotomy  in  which  delineation  of  a  vessel 
boundary  is  required.  A  group  of  images  obtained  from  a  portable  C-scan  ultrasonic  sensor  is  used  to  evaluate  the 
enhancement  and  segmentation  algorithm.  Comparisons  to  a  standard  speckle  reducing  diffusion  algorithm  show  that  the 
model-based  SSIM  diffusion  superior  enhancement  with  a  67%  increase  in  measurable  image  quality  over  the  original.  A  paper 
[7]  reporting  on  this  work  has  been  presented  at  the  2013  5th  IEEE  International  Workshop  on  Computational  Advances  in 
Multi-Sensor  Adaptive  Processing. 

7.  A  novel  compressed  sensing  based  Fourier  shape  descriptor  method  to  compute  the  shape  feature  vector  of  an  arbitrary 
object  has  been  proposed.  First,  the  object  contour  obtained  via  segmentation  is  represented  as  a  complex  signal.  We  then 
formulate  an  optimization  problem  that  exploits  the  sparsity  of  the  shape  feature  of  the  contour.  This  results  in  a  reduced  size 
feature  vector,  which  can  efficiently  represent  the  shape  of  an  object  as  illustrated  by  the  reconstruction  results.  Appropriate  for 
general  shape  retrieval  problems,  we  demonstrate  the  efficacy  of  our  algorithm  by  retrieving  structurally  similar  neurons  from  a 
database.  Currently,  the  representation  and  matching  of  neurons,  given  the  heterogeneous  nature  of  the  neuronal  morphology 
and  the  characteristically  complex  branching  patterns,  is  an  open  problem.  Retrieval  of  structurally  similar  neurons  will 
potentially  enable  classification  of  neurons  imaged.  The  retrieval  results  obtained  using  our  method  provide  evidence  of  efficacy 
with  a  27%  improvement  over  Shell  analysis,  which  is  a  standard  shape  descriptor  used  in  neuroscience.  A  paper  [8]  reporting 


on  this  work  has  been  presented  at  the  2013  Asilomar  Conference  on  Signals,  Systems  and  Computers. 
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